Papers with multi-modality problem
AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate (2021.emnlp-main)
Copied to clipboard
| Challenge: | Non-autoregressive neural machine translation models suffer from the multi-modality problem . aligNART leverages full alignment information to explicitly reduce the modality of the target distribution . |
| Approach: | They propose an alignment decomposition method which explicitly reduces the modality of the target distribution. |
| Outcome: | The proposed model outperforms previous models that focus on modality reduction on two translation tasks. |
Diffusion Directed Acyclic Transformer for Non-Autoregressive Machine Translation (2025.acl-short)
Copied to clipboard
| Challenge: | Non-autoregressive transformers (NATs) often encounter performance challenges due to the multi-modality problem. |
| Approach: | They propose a direct-acyclic transformer (DAT) that captures multiple translation modalities to paths in a Directed Acyclic Graph (DAG) this allows the model to integrate latent variables into the model, which is crucial for DAT to achieve state-of-the-art performance. |
| Outcome: | The proposed model captures multiple translation modalities to paths in a Directed Acyclic Graph (DAG) but the collaboration with the latent variable introduced through the Glancing training is crucial for the model to attain state-of-the-art performance. |
Assessing Non-autoregressive Alignment in Neural Machine Translation via Word Reordering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation models that implicitly model dependencies are sub-optimal in handling word order errors. |
| Approach: | They propose to learn a non-autoregressive language model that can be combined with Viterbi decoding to achieve better reordering performance. |
| Outcome: | The proposed model outperforms state-of-the-art reordering mechanisms under different word permutation settings with a 2-27 BLEU improvement, suggesting high potential for word alignment in NAT. |
Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation models suffer from multi-modality problem . despite their autoregressivity, most NMT models suffer with slow decoding speed . |
| Approach: | They propose a semi-autoregressive model which generates a translation as a sequence of segments while each segment is predicted token-by-token. |
| Outcome: | The proposed model can achieve 4 times speedup while maintaining comparable performance. |
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation models suffer from multimodality problem . multi-modality is not solved by a teacher forcing algorithm, limiting model capability . |
| Approach: | They propose a method that generates multiple reference translations for each source sentence . they compare the NAT output with all references and select the one that best fits the simulated model . |
| Outcome: | The proposed method achieves 29.82 BLEU with only one decoding pass on WMT14 En-De . |
latent-GLAT: Glancing at Latent Variables for Parallel Text Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Recent advances in text generation have limited applications due to multimodality problem. |
| Approach: | They propose a method which uses latent variables to capture word categorical information and invoke an advanced curriculum learning technique to overcome multi-modality problem. |
| Outcome: | The proposed method outperforms strong baselines without an autoregressive model, which further broadens the application scenarios of the parallel decoding paradigm. |
Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive Spoken Language Understanding models suffer from multi-modality problem . current methods have little prior knowledge about the reference during inference . |
| Approach: | They propose a Targeted Knowledge Distillation Framework (TKDF) for multi-intent SLU that utilizes the knowledge distillation method to improve the performance. |
| Outcome: | The proposed model outperforms existing models on two public multi-intent datasets while speeding up by over 4.5 times. |
MRRL: Modifying the Reference via Reinforcement Learning for Non-Autoregressive Joint Multiple Intent Detection and Slot Filling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive models for multiple intent detection and slot filling have limited overall accuracy due to multi-modality problem and lack of alignment between correct predictions. |
| Approach: | They propose a method for multiple intent detection and slot filling that introduces a modifier and employs reinforcement learning to modify the reference. |
| Outcome: | The proposed method outperforms the previous best approach by 3.6 overall accuracy on MixATIS dataset. |
Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive Transformers (NAT) models generate the entire sequence in parallel, but the multimodality problem limits their performance. |
| Approach: | They propose a method to generate distilled data by the NAT model itself, eliminating the need for additional teacher networks. |
| Outcome: | The proposed method can generate distilled data by the NAT model without teacher networks and adapt to different NAT models without precise adjustments. |
Releasing the Capacity of GANs in Non-Autoregressive Image Captioning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive (NAR) models suffer from their inherent multi-modality problem. |
| Approach: | They propose an Adversarial Non-autoregressive Transformer for Image Captioning that improves model performance by modifying model structure to be compatible with contrastive learning. |
| Outcome: | The proposed model achieves 26.72 times faster than the autoregressive model on the MSCOCO dataset. |